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[57] ABSTRACT 

Designs and operational methods to increase the dynamic 
range of image sensors and APS devices in particular by 
achieving more than one integration times for each pixel 
thereof. An APS system with more than one column-parallel 
signal chains for readout are described for maintaining a 
high frame rate in readout. Each active pixel is sampled for 
multiple times during a single frame readout, thus resulting 
in multiple integration times. The operation methods can 
also be used to obtain multiple integration times for each 
pixel with an APS design having a single column-parallel 
signal chain for readout. Furthermore, analog-to-digital con- 
version of high speed and high resolution can be imple- 
mented. 

23 Claims, 5 Drawing Sheets 



f 



column -parallel 
signal chain 



V 



























































































































ill 






■'•V 




m 








m 














































































m. 
















m 


H 


■T; 


:-.-> 











































































Rown-A 
110 



I I I I I I I ITTTU ^ 



sequentially scanned 
for readout 



08/03/2004, EAST Version: 1.4.1 



/ 

i ■ 



U.S. Patent Sep. 5, 2000 sheet 1 of 5 6,115,065 




f 



11 



column-parallel Vr 
signal chain 



110 

Row n 
Row n+1 

104 



sequentially scanned 
for readout 



100 



FIG. 1 



08/03/2004, EAST Version: 1.4.1 



U.S. Patent 



Sep. 5, 2000 



Sheet 2 of 5 



sequentially scanned 
for readout 



2nd column-parallel 
signal chain 



Row n-A 



Row n 



1st column-parallel 
signal chain 



► 

sequentially scanned 
for readout 



FIG. 2 



08/03/2004, EAST Version: 1.4.1 



U.S. Patent 



Sep. 5, 2000 



Sheet 3 of 5 



6,115,065 



302 



„ r315 XH 

aA vdd 



*" ' 316 



300 




FIG. 3 



08/03/2004, EAST Version: 1.4.1 



U.S. Patent 



Sep. 5, 2000 Sheet 4 of 5 



6,115,065 



102 































































































































■;«;■>:■>:• 




































































































111 








it! 


p 















































































column-parallel v*f 
signal chain 



402 



Row n-A 

110 

/ 

Row n 



104 



sequentially scanned 
for readout 



100 



FIG. 4 



08/03/2004, EAST Version: 1.4.1 



U.S. Patent Sep. 5, 2000 Sheet 5 of 5 



6,115,065 



Imaging Pixel Array 

V 



1st column-parallel 
signal chain 

2nd column-parallel 
signal chain 



to- 



Row n-A 



Row n 



sequentially scanned 
for readout 



FIG. 5 



08/03/2004, EAST Version: 1.4.1 



6,115,065 



IMAGE SENSOR PRODUCING AT LEAST 
TWO INTEGRATION TIMES FROM EACH 
SENSING PIXEL 

This application claims the benefit of the U.S. Provi- S 
sional Application Ser. No. 60/006,260, filed on Nov. 7, 
1995. 

ORIGIN OF THE INVENTION 

The invention described herein was made in the perfor- 
mance of work under a NASA contract and is subject to the 
provisions of Public Law 96-517(35 USC 202) in which the 
Contractor has elected to retain title. 

FIELD OF THE INVENTION 15 

The present invention relates to semiconductor image 
sensor, and more specifically, to a system and method of 
extending dynamic range in CMOS active pixel sensor 
circuits. 20 

BACKGROUND AND SUMMARY OF THE 
INVENTION 

An active pixel sensor ("APS") is a special kind of light 
sensing device. Each active pixel includes a light sensing 25 
element and one or more active transistors within the pixel 
itself. The active transistors amplify and buffer the signals 
generated by the light sensing elements in the pixels. One 
type of such APS devices is disclosed in U.S. Pat. No. 
5,471,515 by Fossum et aL, the disclosure of which is 
incorporated herein by reference. 

APS devices represent an emerging technology in a wide 
range of imaging applications. APS has a number of sig- 
nificant advantages in comparison with the well-developed 3S 
and widely used charge coupled devices (CCDs). Because of 
the number of stages in a CCD, a nearly perfect charge 
transfer efficiency must be maintained in a CCD in order to 
maintain good signal fidelity. This usually makes CCDs 
susceptible to damage from both ionizing and displacement 4Q 
damage. In particular, the displacement damage caused by 
high-energy particles and photons may prove to be deadly to 
CCDs. 

Large CCD arrays present engineering difficulties in 
manufacturing. Device miniaturization is difficult with CCD 45 
devices since the extreme requirements of CCDs necessitate 
a special formation process. This formation process prevents 
CCDs from being easily integrated with on-chip integrated 
circuits such as complementary-metal-oxide -semiconductor 
(CMOS) integrated circuits. CCDs also suffers limited spec- 50 
tral responsivity range and readout rates. Furthermore, the 
readout of CCDs is destructive, i.e., their stored value is 
destroyed upon reading out. Implementation of the nonde- 
structive readout in a CCD device is difficult. 

In contrast, an APS device receives and processes input 55 
signals with the active pixel itself, thus eliminating the 
charge transfer over distances that are inherent in CCDs. 
Consequently, many drawbacks associated with CCDs are 
avoided in APS devices. For example, the performance of 
APS devices can be maintained as the array size increases. 60 
The APS readout rate is usually higher than that of CCDs. 
Since CMOS circuitry is often associated with the image 
sensor, the power consumption can be significantly reduced. 
APS devices are inherently compatible with CMOS 
processes, allowing reduced cost of manufacturing. Many 65 
on-chip operations and controls can be relatively easily 
implemented including timing and analog -to-digital conver- 



sion. APS devices are also less vulnerable to radiation 
damage and can be designed for non-destructive readout. 
Moreover, the active pixels of APS devices allow random 
access and on-chip signal processing. 

One important benchmark in performance of imaging 
devices is the ratio of the saturation level of the detectors and 
the noise level thereof or the signal-to-noise ratio (SNR). 
This can be expressed in terms of dynamic range of the 
device. The dynamic range is usually expressed in dB by 20 
log(SNR) or in binary (bits) by lofe (SNR). The larger the 
dynamic range, the better an imaging devices. 

In particular, a large dynamic range is desirable in appli- 
cations for sensing low light signals and capturing images 
with large variations in brightness. 

The dynamic range of previously-reported CMOS-based 
APS circuits has been limited by both the saturation level of 
the signal chain circuit, which is typically about 1.2 volts for 
a 5-volt power supply, and the noise floor of the sensor, 
which is typically about 150 ^V. This results in a dynamic 
range of approximately 78 dB (13 bits), which is comparable 
to the dynamic range of the state -of-art CCD devices. 

The output voltage signal of an imaging device is depen- 
dent on the input light level, the efficiency of the optical 
coupling device and the detector characteristics including 
the quantum efficiency, the effective active sensing area, the 
integration time, and the electrical conversion gain of volts/ 
electron. The output signal can be approximately expressed 
as the following: 



'4/1' 



(1) 



where <I> is the incident photon flux, f is the f-stop of the 
coupling optical system, t opIiC s ^ me transmission of the 
optical system, A det is the pixel size, J int is the integration 
time, T) is the pixel quantum efficiency, and G is the 
conversion gain in volts/electron. The typical values for a 
APS device are f78, 80% for x optics , 20 /an for K detJ 33 ms 
for T^„ 25% in -n, and G=10 pNjtr, respectively. 

The exposure of an imaging device for a given hardware 
configuration is usually controlled by changing either the 
aperture (i.e., f-stop) or the integration time. If the input light 
level is low, the integration time can be increased to improve 
the signal-to-noise ratio. If the input light is bright, the 
integration time is reduced to avoid saturation of the detector 
while maintaining a high SNR. The lower limit of the 
integration time is set by the readout time. 

A number of prior-art techniques exist for controlling the 
integration time. For example, the integration time of a 
CMOS APS device with N rows of pixels can be controlled 
by resetting a row of pixels in advance of readout. If the 
readout time for one row of pixels is T roK ,, the total frame 
readout time is NT row . Since the pixels of a row are reset for 
a new integration upon readout, the integration time is 
simply the frame time NT W>V . 

FIG. 1 illustrates an exemplary APS. Apixel array 102 has 
N rows of pixels with each row having M columns. A 
column-parallel signal chain 104 such as a sampling capaci- 
tor bank with M storage cells is used for readout. 

In a specific operation of readout, a particular row is 
selected for readout at one time. The sensor data from the M 
pixels in the selected row is copied onto the capacitor bank 
104. The copy process also resets the pixels in the selected 
row and begins a new integration. The M storage cells in the 
capacitor bank 104 is then scanned sequentially for readout. 
The above readout process is then repeated for the next row. 
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Therefore, the integration time for each pixel is identical and Special advantages are obtained when used with non- 

is equal to the readout time of a frame, i.e., NT^. destructive readout of an APS device in achieving multiple 

Another prior-art approach uses an electronic switching integration times of each pixel, 

mechanism built in the pixel design of a CMOS APS device, Another aspect incorporates digital processors including 

allowing electronic shuttering and simultaneous integration. 5 analog-to-digital converters in the column-parallel signal 

This was disclosed in U. S. Provisional Application No. chains. 

60/010,305 filed on Jan. 22, 1996 by Fossum et al. On-chip buffer memory units and/or multiple source 

The inventors of the present invention recognized a followers may be used for each pixel to further enhance the 

limitation of the above two methods in that the exposure flexibility and performance of the systems in accordance 

remains the same for the entire image. This can result in 10 with the present invention, 
distortion of the detected images in some circumstances. For 

example, an outdoor scene might be optimally exposed for BRIEF DESCRIPTION OF THE DRAWING 

the sunlit areas but overexposed in the shadowed areas. This These ^ otne r advantages of the present invention will 

can result in loss of detail in shadowed areas. become more apparent in the light of the following detailed 

One solution to the above problem is to use a nonlinear 15 description of preferred embodiments thereof, as illustrated 

output sensor. Such a sensor is designed to have a high in me acc0 mpanying drawings, in which: 

differential gain for lighUevels and low differential gam for nG j iUustrates m active M sensor ^ a si le 

high light levels. It is desirable that the nonlinear gam be column . paraUel signal chain to produce the same integr ation 

achieved within each pixel. As a result, pixel to pixel ^ for every pixel 

variations in the transfer function can lead to unacceptable 20 ' . . , 

values of fixed pattern noise. FIG - 2 shows m actlve V mcl sensor ^ column * 

Another approach is to implement multiple storage sites parallel signal chains for readout in accordance with a 

in each pixel in CCD devices to record different integration Purred embodiment of the present invention, 

signals from the same pixel. In case of two storage sites in FIG. 3 shows one example of an active pixel structure and 

each pixel, one storage site corresponds to a short integration 25 a cell for the column-parallel signal chain disclosed by the 

period and the second to a long integration period, thus U.S. Pat. No. 5,471,515. 

increasing the dynamic range. The readout data can be FIG. 4 shows a readout method for achieving multiple 

transformed to a lower bit count encoding using nonlinear integration times using an active pixel sensor with a single 

techniques for display, storage, and transmission. One limi- column-parallel signal chain. 

tation of this technique is a decreased readout rate since the 30 FIG 5 shows anot her floor plan for positioning the two 
readout time may be doubled since twice as much of the column-parallel signal chains relative to the active pixel 
amount of data may need to be read. Another limitation is the array, 
reduced fill factor since two storage sites occupy consider- 
able pixel area. DESCRIPTION OF THE PREFERRED 

In view of the above limitations, the present invention 35 EMBODIMENTS 

describes a new technique in APS sensors and operation Tfae description of the preferrcd embodiments will use 

methods thereof to increase their dynamic ranges. According CMQS ^ deyices as ^ example for implemen t a tio n . 

to the preferred embodiments of the present invention, at However, it should be understood that the method and 

least two different integration times are obtained for each desi caQ also be i^^ted in other active pixel sensors, 

active pixel. One or more column-parallel signal chains are 40 an(J be usaWe [n Qther ^ iri tems 

used to implement the multiple integration times for each _ . A uv a ^ *• u j 

active pixel. For an APS device with only one column- Des1 ^ Architectures and Operation Modes 

parallel signal chain for readout, each pixel is sampled FIG - 2 illustrates the first preferred embodiment 200 of 

multiple times during a single frame readout, thus resulting invention. An active pixel array 202 has N rows 

in multiple integration times. 45 ** d M columns, hence with a total of NxM pixels. Each 

Another aspect of the present invention increases the P* el comprises a light sensmg element and one or more 

frame rate by using more than one column-parallel signal active transistors. The active transistors amplify and buffer 

chain to achieve multiple data points of different integration ^ generated by the light sensing element in the 

times for each pixel. A maximal frame rate is achieved for P ixel - Each active P™ tl has one 0Ut P ut source follower that 

a given APS device by having the number of column- 50 15 connected to the corresponding column bus. There are two 

parallel signal chains match the number of different inte- column-parallel signal chains for readout. Each of the signal 

gration times. A preferred operation mode of such system in chains > 204 md 206 > has M stora S e ^ for temporarily 

accordance with the present invention includes simulta- storin S the electrical signals from the pixels being read. The 

neously copying multiple columns into the column-parallel column-parallel signal chains 204 and 206 can be imple- 

signal chains and subsequently reading out all the column- 55 mented ™ ih capacitor banks for analog processing and 

parallel signal chains simultaneously with each being analog-to-digital converters (ADCs) for digital processing 

scanned in a sequential manner. The frame rate is increased or an y other device that 15 ca P able of stonn S ma g e infor ' 

by a factor equal to the number of the column-parallel signal mauon. 

chains as compared with achieving the same number of The device 200 also includes an control circuit (not 

integration times with a single column-parallel signal chain 60 shown) having row and column decoders for addressing the 

for readout. The dynamic range of the APS device is thus proper row/column of pixels, clock generator circuits for 

extended by a factor given by the ratio of the longest synchronization, and readout circuits. The control circuit is 

integration time versus the shortest integration time. operable to control the readout of the pixels and the opera- 

Anew readout method is also described. This method can lion of the column-parallel signal chain(s) in a desired 

be used to improve the dynamic range of a conventional APS 65 sequence with desired integration time(s). 

device having a single column-parallel signal chain by An example of such active pixel and the storage cell in a 

achieving multiple integration times for each active pixel. column-parallel signal chain is shown in FIG. 3. This is 
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disclosed in the incorporated reference U.S. patent applica- 
tion Ser. No. 5,471,151 which describes an active pixel array 
with a single column-parallel signal chain for readout. FIG. 

3 shows the active pixel 302 including a photogate 310, a and the integration time for the signals copied to the second 

DC biased transfer gate 311, an output floating diffusion 5 column-parallel signal chain 206 is given by 
314, a reset transistor 315, a drain diffusion 316, a gate 
source follower 317, and a row selection transistor 318. The 
circuit 304 represents a storage cell shared by a column of 

active pixels. The storage cell 304 includes a load transistor As a result, the dynamic range D 2 of the active pixel 

320, a first output circuit 321 for buffering and exporting the 10 sensor 200 is improved over the dynamic range D 1 of the 

reset level, and a second output circuit 322 for buffering and system 100 by a factor of T li JT 2im : 
exporting the signal level. In the architecture shown in FIG, 

2, each active pixel of a column is connected to two such D 2 (dB) = logf— Wz>,(dB)- (6) 

storage cells substantially similar to 304. It should be 1 ' 

understood that other designs of the active pixel and column is 
storage cell can also be used in accordance with the present 

invention. ^ 

In operation, a row of pixels in the active pixel array 202, £>2(bits) = log^^) + Difbits). 
e.g., the row n 210, is first selected for readout. The signals 

representing the M pixels of the row n 210 are copied 20 

simultaneously to the corresponding M storage cells in the For example, when N=5\2 and A=2, then a 13-bit dynamic 

first column-parallel signal chain 204. The time duration of range is thus extended by 8 bits to 21 bits, or from 78 dB to 

the copying process is T copy , typically about 1-10 for an 126 dB. 

APS device. The copying process also resets the pixels in the The detected image is reconstructed by reading out the 

row n 210 and a new integration in the row n 210 is started. 25 bright portions of the image with the data of short integration 

Secondly, the signals of M pixels in another row 220 that is time T 2int from the second column -parallel signal chain 206. 

shifted by A rows relative to row 210, i.e., the row (n-A), are Conversely, darker portions of the image are read out using 

simultaneously copied to the corresponding M storage cells the data of long integration time T lint from the first column- 

in the second column-parallel signal chain 206 during time parallel signal chain 204. Therefore, portions of a scene 

T copy and the pixels in the row (n-A) 220 are subsequently 30 which appear saturated by the long integration time T lint can 

reset for another integration. The M storage cells in each of be managed by using the short integration time T^,. 

the first column-parallel signal chain 204 and the second The second embodiment of the present invention uses the 

column-parallel signal chain 206 are simultaneously and readout technique for the system 200 of FIG. 2 in the system 

respectively scanned for readout. Hie M storage cells in 100 of FIG. 1 to extend the dynamic range. The readout 

each column-parallel signal chain is sequentially scanned 35 sequence is illustrated in FIG. 4. The row n of pixels 110 in 

and the signals therein are read out. This completes the the active pixel array 102 is first selected for readout. The 

readout of the row n 210 and row (n-A) 220. The time for signals in the M pixels of the row n 110 are then copied 

scanning and reading one pixel is T scan , which is typically simultaneously to the corresponding M storage cells in the 

between 100 ns-10 /^s. Then, the next two rows are selected column-parallel signal chain 104. The copying process also 

for readout in the same fashion. Therefore, a single row 40 resets the pixels in the row n 110 and begins a new 

readout process reads two separated rows of pixels. integration in the row n 110. Subsequently, the M storage 

The above readout process repeats until every row in the cells of the column-parallel signal chain 104 is sequentially 

active pixel array 202 are read to complete a frame. This scanned and the signals therein are read out. Next, the 

results in two sets of data from every active pixel in the array signals of M pixels of another row(n-A) 402 are simulta- 

202, one from the first column-parallel signal chain 204 and 45 neousiy copied to the corresponding M storage cells in the 

another one from the second column-parallel signal chain column-parallel signal chain 104. The row 402 is displaced 

206, respectively. The two sets of data have different inte- & om lne row 110 °y A number of rows. The pixels in the row 

gration times and the two data points for the same pixel are (n-A) 402 are subsequently reset for another integration, 

read out at different times by a time lag of the time for a row Subsequently, the M storage cells of the column-parallel 

readout process multiplied by A. 50 si S naJ chain 104 is ag™ sequentially scanned and the 

The time for a row readout is si § nals merein ^ read oni ' ^ completes one row readout 

process which takes a total time of (2T co/y +2MT^ can )- 
2T 

1 row 

Trow-iTcopy+MTscan, (2) The above process then repeats for row (n+1) and row 

comparing to (T^+MT^) in a row readout in the prior- 55 (n-A+1), etc. until all N rows of active pixels in the array 

art system as in FIG. 1. The total readout time for a frame 102 are processed. The totalframe readout time is N(2T Cf?p> + 

is given by: 2 MT rcfl J=2NT row , which is twice as long as the frame time 

in the prior-art readout shown in FIG. 1. However, two sets 
of data are obtained using the readout of FIG. 4, one set 

T /raw ,=NTV~, < 3) 60 having a first integration time, T 1( .„,=(N-A)2T TOH , and 

In the prior- art system of FIG. 1, the integration time for another set having a second integration time, T li>w =A2T roH ,. 

each pixel is the same and is the readout time for a frame. 1\vo data points of different integration times from the same 

However, the two sets of readout from the two column- pixel are read out at two different times. The time lag 

parallel signal chains 204 and 206 in the system of FIG. 2 between reading out the two data points is A(2T ccyjy + 

have different integration times. The integration time for the 65 2MT rcfl7l )-2AT, w( . 

signals copied into the first column-parallel signal chain 204 The increase in the dynamic range is essentially the same 

is given by: as in the first embodiment using a sensor design 200 of two 
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column-parallel signal chains although the integration times 
are different. The second embodiment has an additional 
advantage of being compatible with previously-fabricated 
CMOS APS sensors with single column-parallel signal 
chain but has a reduced frame rate for readout due to the 5 
increased readout time per frame. 

A third embodiment implements more than two integra- 
tion times in an active pixel array. For a number of k 
integration times (k>l) for each active pixel, the respective 
integration times are T^-kAjT,^, T 2in =k A 2 T WVV , . . . , and 10 
T^-kCN-Aj-Aj . . . -A^yi^, if the architecture 100 of 
FIG. 1 is used in which there is only one column-parallel 
signal chain for readout. The respective readout time for a 
frame is T Aame =NkT rovv . For example, N=585 and k=4, A a 
may be chosen to be 1, A 2 -8, A 3 -64 so that T ll - m -lx4T rovv , 15 
T 2iw =8x4T row7 T 3£K =64x4T row , and T^ =512x4T roM ,. 

In addition, k column-parallel signal chains can be imple- 
mented and used in a similar way as in the first embodiment 
200. k rows of pixels are read out simultaneously and stored 
in the k column -parallel signal chains, respectively. The k 20 
column-parallel signal chains are subsequently scanned and 
read out simultaneously. Thus, the frame time is reduced by 
approximately a factor of k while achieving essentially 
similar dynamic range increase comparing to the use of a 
single column-parallel signal chain for k integration times. 25 

Furthermore, an intermediate number of column-parallel 
signal chains between 1 and k can be used to produce a 
desired set of k integration times and a frame rate tailored for 
a specific application. At least one of the column-parallel 
chains is used to obtain at least two sets of data with different 30 
integration times. 

The above embodiments contemplate using a destructive 
readout, wherein an active pixel is reset for another integra- 
tion after the signal therein is copied and read out. One 
advantage of the destructive readout is that the on-chip 35 
correlated doubling sampling can be implemented in many 
active pixel sensors to suppress noise such as the fixed patten 
noise and the kTC noise. This is disclosed by Mendis et al. 
in "CMOS Active Pixel Image Sensor", IEEE Transactions 
On Electron Devices, Vol. 41(3), pp.452r^53, March, 1994. 40 
A non-destructive readout can also be used with the above 
embodiments for an increased dynamic range and possibly 
increased speed. Each pixel continues to integrate the signal 
and the pixel value is copied and read out without resetting. 
One advantage of the non-destructive readout is that a fewer 45 
number of rows are needed than that in the destructive 
readout to achieve the same multiple integration periods. For 
example, non-destructive readout can be used to achieve 



four different integration times T lin =lx4T n 



=8x 



50 



column-parallel signal chain with 512 rows of pixels rather 
than 585 rows in the destructive readout. This can be done 
by choosing A A =1, A 2 =7, and A 3 =56 in a 512-row active 
pixel array. 

Device Implementation 

(1) Choice of Pixel 

The architectures of active pixel array for extended 
dynamic range previously described can be implemented 
with a number of possibilities. The preferred pixel design is 
a photogate CMOS APS shown in FIG, 3. However, many 
pixel designs of active -type and passive-type can be used. 
Examples of such include photo diode CMOS APS, a pinned 
photodiode CMOS APS, the passive pixel photodiode 
sensor, the charge modulation device active pixel sensor, and 
bipolar transistor-based pixels. 



55 



60 



(2) Chip Layout 

One or more column-parallel signal chains can use dif- 
ferent elements in the pixels thereof including capacitors and 
analog-to-digital converters (ADCs). The physical floor 
plans of multiple column-parallel signal chains such as FIG. 
2 and single column-parallel signal chain as in FIG. 1 can be 
varied as desired in practicing the present invention. For 
example, the second column-parallel signal chain 206 can be 
positioned with the first column-parallel signal chain 204 at 
the lower part of the active pixel array 202 as illustrated by 
FIG. 5. 

(3) Multiple Outputs per Pixel 

The inventors contemplate that a plurality of output 
source followers can be included in each pixel rather than 
one output source follower as described hereabove (e.g., 
FIG. 3). Each output source follower can be attached to a 
separate column bus and each column bus in turn can be 
attached to its own column parallel signal chain. This 
approach may provide greater flexibility in choosing the 
integration times. 

(4) Pixel Synchronization 

The above -described embodiments use multiple data 
points of different integration times from the same pixel 
which are read out at different times rather than simulta- 
neously. If it is desired to synchronize the output of the two 
or more data points from the same pixel, an on-chip buffer 
memory is needed. The buffer memory holds the data from 
a pixel until all data points from that pixel are read out so 
that all the data points can be sent out simultaneously. In the 
case of the first embodiment 200 of FIG. 2, the buffer 
memory should be A rows in size and has a capacity of 
storing half of the data from an image in the worst case. If 
on-chip ADC is used, the output of the buffer memory can 
be the input to the ADC. 

A High Performance Analog-to-Digital Converter 
("ADC) 

A high speed ADC with a high resolution can be made 
using the described techniques of the present invention. The 
multiple data points generated from each pixel can be 
converted from analog to digital with multiple ADCs with 
each data point being processed by one ADC. This can 
generate both a high resolution conversion by combining the 
bits from each data point and a fast conversion speed since 
the multiple ADCs operate in parallel. 

For example, the architecture shown in FIG. 1 with a 
readout of four data points per pixel can be used for such a 
ADC. For illustration purpose, it is assumed that N=585, 
k=4, A 1= l, A 2 -8, A 3 =64 so that T^=lx4T TOVV , T 2int =Sx 
4T^, T 3m/ =64x4T TOVV , and ^,=512x4^. If each data 
point is converted using a 3-bit ADC, an ADC word length 
of 12 bits can be generated by patching the four outputs of 
the ADCs together. The time domain, which can be accu- 
rately controlled, is used to provide the effective gain of 8x 
between each of the four data points. This is shown in Table 
1. Each of the four ADCs is shown as a single slope ADC, 
with an increment of 0.250 mV per step and a total of 8 
levels. The time required for each conversion is 8 cycles. 
Since the four ADCs can be operated in parallel, the total 
time to achieve the 12-bit resolution could remain as 8 
cycles. Typically, each cycle is of the order 1 /fs so that a 
complete conversion can be finished in 8 /us. The bits from 
the four ADCs corresponding to four data points are reas- 
sembled externally to generate the 12-bit output. 
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Integration 


1 


8 


64 


512 


Time fT„ w ) 










Number or 


8 


8 


8 


8 


Steps 










Actual volts 


0.250 mV 


0.250 mV 


0.250 mV 


0.250 mV 


per step 










Effective volts 


128.00 mV 


16.000 mV 


2.000 mV 


0.250 mV 


per step 










Full effective 


1024.000 mV 


128.000 mV 


16.000 mV 


2.000 mV 


range 











TABLE 1 




It is noted that achieving n-bit dynamic range is not 20 
equivalent to obtaining n-bit resolution. For example, the 
sensor of the above-described case could be saturated for the 
three long integration times for a given light intensity at a 
pixel, thus only the data with the shortest integration time is 
used. One way to improve the number of significant digits 25 
is to used a higher resolution ADC to have some overlap in 
conversion range. 

Although the present invention has been described in 
detail with reference to several embodiments, one ordinarily 
skilled in the art to which this invention pertains will 30 
appreciate that various modifications and enhancements 
may be made in the described embodiments. 

For example, the techniques of the embodiments 
described use readout units of rows and column-parallel 
readout chains. It should be appreciated that readout units 35 
could be other pixel blocks, such as neighboring pixel 
patches (e.g., 7x7 pixel areas), or any other desired shape. 
Accordingly, the readout chains can be changed to accom- 
modate the choice of readout units. While the embodiments 
describe obtaining two integration signals for each pixel <*o 
being stored, it should be understood that any number, e.g., 
3 or 4, integration times could be used. Additional column - 
parallel signal chains may be added to maintain the frame 
rate while increasing the number of integration times. 
Alternatively, the chip design can be maintained at a price of 45 
a slower frame rate to increase the number of integration 
times using the readout method of the present invention. 

These and other modifications and enhancements are 
intended to be encompassed by the following claims. 

What is claimed is: 50 
1. An imaging device, comprising: 
a substrate formed of a semiconductor material; 
an image detector array, having a plurality of pixel circuits 
formed on said substrate, each pixel circuit generating 55 
a pixel signal indicative of a pixel of an image; 
a first signal buffer, formed on said substrate and coupled 
to respectively store pixel signals from a first group of 
said pixel circuits; 
a second signal buffer, formed on said substrate and eo 
coupled to respectively store pixel signals from a 
second group of said pixel circuits, wherein said second 
group is displaced from said first group by a predeter- 
mined number of pixel circuits; and 
a control circuit coupled to control said image detector 65 
array and said first and second signal buffers, said 
control circuit controlling reading out pixel circuits into 



said first buffer with a first integration time and con- 
trolling reading out pixel circuits into said second 
buffer with a second integration time different than said 
first integration time, said first and second buffers 
storing two different signals with two different integra- 
tion times for each pixel circuit, 
wherein said first and second integration times have a 
difference which depends on said predetermined num- 
ber of pixel circuits between said first and second 
groups, 

wherein said control circuit is adapted to select signals 
with said first integration time from a first group of 
pixel circuits and signals with said second integration 
time from a second group of pixel circuits to form said 
single frame where said first group of pixel circuits 
receive less light than said second group of pixel 
circuits. 

2. A device as in claim 1, wherein said control circuit is 
further adapted to simultaneously read two different groups 
of pixel circuits that are separated by said predetermined 
number of pixel circuits into said first and second buffers, 
respectively. 

3. A device as in claim 2, wherein said control circuit is 
further adapted to vary said predetermined number of pixel 
circuits between two different groups of pixel circuits, that 
are being simultaneously and respectively read into said first 
and second buffers, so as to change said difference between 
said first and second integration times. 

4. A device as in claim 2, further comprising: 

a first ADC array of an alog-to -digital converters respec- 
tively coupled to cells of said first buffer array to 
produce a first portion of digital bits from signals of 
said first integration time; and 

a second ADC array of analog-to-digital converters 
respectively coupled to cells of said second buffer array 
to produce a second portion of digital bits from signals 
of said second integration time, 

wherein said control circuit is adapted to combine said 
first and second portion of digital bits from said first 
and second ADC arrays of analog-to-digital converters 
for each pixel into a digital output having a higher 
resolution than resolutions of said analog-to-digital 
converters in said first and second ADC arrays. 

5. A device as in claim 1, further comprising a transistor 
amplifier in each pixel circuit. 

6. A device as in claim 1, further comprising a buffer 
memory formed on said substrate adapted to store output 
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signals from each pixel circuit that are generated at different 
times and respectively have said first and second integration 
times during a frame readout so as to allow a simultaneous 
readout of said output signals. 

7. A device as in claim 6, wherein said buffer memory has 5 
a number of memory cells equal to said predetermined 
number of pixel circuits between said first and second 
groups. 

8. A device as in claim 1, wherein said controlling circuit 
has means for enabling each pixel circuit to accumulate 10 
signals during consecutive readouts by one of said buffer 
cells in said first and second signal buffer arrays. 

9. A device as in claim 1, further comprising a reset gate 
in each pixel circuit, wherein said control circuit is operable 

to control said reset gate to delete accumulated signals upon 15 
a completion of a sampling by either said first signal buffer 
array or said second signal buffer array. 

10. A device as in claim 1, wherein said control circuit is 
further adapted to sample each pixel circuit at least three 
times with said first and second signal buffer arrays to 20 
produce said single frame to generate three sets of data with 
different integration times for each of said pixel circuits, 
wherein at least one of said first and second signal buffer 
arrays operates to sample said pixel circuits twice. 

11. An imaging device, comprising: 25 
a substrate; 

a detector array having a plurality of pixel circuits formed 
on said substrate to generate signals indicative of an 
input scene; 

a signal buffer array having a plurality of buffer cells 
formed on said substrate that are coupled to a patch of 
pixel circuits to store signals from said patch of pixel 
circuits; and 

a control circuit coupled to control said detector array and 
said signal buffer array to read each pixel circuit within 
a patch of pixel circuits at least once into said signal 
buffer array to have a first integration time, and after 
sequentially reading a predetermined number of 
patches, to read each pixel circuit within said patch of 40 
pixel circuits at least another time into said signal buffer 
array to have a second integration time to produce a 
single output frame, hence each pixel circuit producing 
at least two different output signals with different 
integration times, 45 

wherein said first and second integration times have a 
difference which depends on said predetermined num- 
ber of patches of pixel circuits, 

wherein said control circuit is adapted to select signals 
with said first integration time from a first group of 50 
pixel circuits and signals with said second integration 
time from a second group of pixel circuits to form said 
single frame where said first group of pixel circuits 
receive less light than said second group of pixel 
circuits. 55 

12. A device as in claim 11, wherein said control circuit 
is further adapted to vary said predetermined number of 
patches to change said difference between said first and 
second integration times. 

13. A device as in claim 11, further comprising a transistor 60 
amplifier in each pixel circuit. 

14. A device as in claim 11, further comprising a buffer 
memory formed on said substrate adapted to store output 
signals from each pixel circuit that are generated at different 
times and respectively have said first and second integration 65 
times during a frame readout so as to allow a simultaneous 
readout of said output signals. 



35 



15. A device as in claim 14, wherein said buffer memory 
has a number of memory cells equal to a number of pixel 
circuits in said predetermined number of patches. 

16. A device as in claim 11, further comprising an ADC 
array of analog-to-digital converters respectively coupled to 
cells of said buffer array, each analog-to-digital converter 
operable to produce a first portion of digital bits from a 
signal of said first integration time of each pixel and to 
produce a second portion of digital bits from a signal of said 
second integration time of each pixel, 

wherein said control circuit is adapted to combine said 
first and second portions of digital bits for each pixel 
into a digital output having a higher resolution than a 
resolution of said analog-to-digital converters. 

17. A method of using an image array of sensing pixels to 
detect an optical image, comprising: 

receiving light from an image using an image array to 
produce pixel signals; and 

sequentially reading out the pixel signals from the image 
array to produce a single output frame by reading out 
two units of sensing pixels that are separated by a 
predetermined amount of sensing pixels to obtain, for 
each of the sensing pixels, a first integration-time pixel 
signal and a second integration-time pixel signal that 
have different integration times depending on said 
predetermined amount. 

18. A method as in claim 17, further comprising combin- 
ing at least a portion of the first integration-time signals from 
a first group of pixels obtained in a frame readout and a 
portion of the second integration-time pixel signals from a 
second group of pixels from the same frame readout to form 
an output frame. 

19. A method as in claim 17, wherein said pixel circuits 
are arranged in columns and rows and further comprising: 

providing a first signal readout buffer array having buffer 
cells that are respectively coupled to pixels in each 
column; 

simultaneously reading a first row into said buffer cells of 

said first readout buffer array to obtain a set of the first 

integration-time pixel signals; 
sequentially scanning said buffer cells in said first readout 

buffer array and reading out said set of the first 

integration-time pixel signals; 
selecting a second row in said array which is separated 

from the first row by the predetermined number of 

rows; 

then simultaneously reading said second row into said 
buffer cells of said first readout buffer array to obtain a 
set of the second integration-time pixel signals; 

then sequentially scanning said buffer cells in said first 
readout buffer array and reading out said set of the 
second integration-time pixel signals; and 

repeating each of the above reading process for a row next 
to the first row and another row next to the second row 
until all rows are read. 

20. A method as in claim 17, wherein said pixel circuits 
are arranged in columns and rows and further comprising: 

providing a first signal readout buffer array having buffer 
cells that are respectively coupled to pixels in each 
column; 
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providing a second signal readout buffer array having 
buffer cells that are respectively coupled to pixels in 
each column; 

simultaneously reading a first column and a second col- 
umn into said first readout buffer array and said second 
readout buffer array, respectively, to obtain a set of the 
first integration-time pixel signals in said first readout 
buffer array and a set of the second integration-time 
pixel signals in said second readout buffer array; 



21. A method as in claim 17, further comprising: 
producing a first portion of digital bits from a first 

integration-time pixel signal of a pixel; 
producing a second portion of digital bits from a second 

integration-time pixel signal of the same pixel; and 
combining the first and second portions of digital bits into 

a digital output for the same pixel. 

22. A method as in claim 17, further comprising depleting 



then simultaneously scanning said buffer cells in said first 10 a pixel signal in a pixel circuit after reading the pixel circuit 



and second readout buffer arrays and reading out said 
set of first integration-time pixel signals and said set of 
the second integration-time pixel signals, respectively; 
and 

repeating the above reading and scanning operations to a 
row next to the first row and another row next to the 
second row until alt rows are read. 



to initiate a new integration process. 

23. A method as in claim 17, further comprising selecting 
one of the two different pixel signals from each pixel to form 
an indicia of the input scene according to an amount of light 
received by each pixel. 
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